TITLE OF THE INVENTION 

STREAM DATA PROCESSING APPARATUS 

BACKGROUND OF THE INVENTION 

Field of the Invention 
[0001] The present invention relates to a stream data processing 
apparatus which performs multiple steps of processing for stream 
data . More particularly , the present invention relates to a stream 
data processing apparatus in which data is transmitted or received 
between a plurality of processing sections while achieving 
synchronization therebetween . 

Description of the Background Art 
[0002] Stream data processing apparatuses for performing 
multiple steps of processing for stream data such as audio data 
or video data are known . A typical stream data processing apparatus 
comprises an input section, a processing section, and an output 
section, such that the processing section performs a predetermined 
process for inputted stream data, and outputs the processing 
results thus obtained. In many cases, a stream data processing 
apparatus performs a processing consisting of a plurality of steps 
for the inputted stream data. To this end, the stream data 
processing apparatus comprises a plurality of processing sections 
for executing the processes of the respective steps, and data is 
transmitted or received between such processing sections . Thus , 




the stream data processing apparatus executes multiple steps of 
processing in a pipeline manner for the inputted stream data. 
Sometimes instructions such as interruption of a process or a seek 
(i.e., commencing processing at a different position in a given 
5 stream of data which is being processed) may be given to the stream 
data processing apparatus. In order to ensure proper operation 
when receiving such instructions, the stream data processing 
apparatus performs exchange of data while achieving 
synchronization between the plurality of processing sections. 

10 [0003] Japanese Patent No. 3095290 discloses a method, 
performed in a stream data processing apparatus, of exchanging 
data while achieving synchronization between a plurality of 
processing sections. According to this method, each processing 
section acquires via communications the state of another processing 

15 section with which it is exchanging data, and switches its own 
operation in accordance with the state of the other processing 
section. For example, when a seek instruction is given to the 
stream data processing apparatus, the processing section which 
is at the receiving end of data must postpone the receiving of 

20 data until the processing section at the transmitting end of data 
begins to transmit a processing result for the data corresponding 
to the new position. In order to realize such a function, each 
processing section controls its own operation so as not to read 
any improper data, in accordance with the content of the received 

25 data, the progress of the process, and the state of the other 



processing section. Thus, by properly exchanging data between 
a plurality of processing sections while achieving synchronization 
therebetween, the stream data processing apparatus can operate 
with a good overall integrity. 

[ 0004 ] However , achieving synchronization between a plurality 
of processing sections using the above-described method has the 
following problems . Since each processing section needs to 
control its own operation in accordance with the data content, 
progress of the processing, and the state of another processing 
section, the structure of each processing section becomes 
complicated. When implementing each processing section in 
software, in particular, the structure of the software component 
constituting each processing section becomes complicated. 
Moreover, since a unified interface is not used between the 
respective processing sections in the above-described method, it 
is difficult to port the software component constituting each 
processing section into another system. 

SUMMARY OF THE INVENTION 

[0005] Therefore, an object of the present invention is to 
provide a stream data processing apparatus in which data is 
exchanged between a plurality of processing sections while 
achieving synchronization therebetween, such that. each processing 
section is capable of performing the exchange of data without having 
to pay attention to the data content, progress of the processing. 



and the state of another processing section. Another object of 
the present invention is to unify the interface between the 
processing sections included in the stream data processing 
apparatus, thereby simplifying the structure of each processing 
5 section and improving the reusability of each processing section. 
[0006] The stream data processing apparatus according to the 
present invention comprises a transmitting-end processing section, 
a receiving-end processing section, a control section, a data 
temporary storage section, an empty data storage section, and a 

10 connection management section, and performs multiple steps of 
processing for stream data. The transmitting-end processing 
section performs a process of one of the multiple steps of processing . 
The receiving-end processing section performs a process of a next 
one of the multiple steps of processing . The connection management 

15 section employs the data temporary storage section as a buffer 
for allowing the data transmitted from the transmitting-end 
processing section to be received by the receiving-end processing 
section. If it becomes necessary to change the subject of 
processing due to a seek or a change of the stream data, each 

20 processing section outputs a clear request to the connection 
management section in response to an instruction from the control 
section. The connection management section switches a write 
destination and a read source depending on whether the connection 
management section is in a normal operation state, a receiving-end 

25 clear wait state which exists after the transmitting-end clear 

4 



request is received and until the receiving- end clear request is 
received , or a transmitting-end clear wait state which exists after 
the receiving-end clear request is received and until the 
transmitting-end clear request is received. As a destination 
5 for such switching, an empty data storage section, which erases 
any data written thereto in response to a data write and returns 
empty data in response to a data read, is used. 
[0007] As a first example method of switching, the connection 
management section may select the empty data storage section as 

10 the read source in the receiving-end clear wait state, and select 
the empty data storage section as the write destination in the 
transmitting-end clear wait state. When this method of switching 
is adopted, the connection management section erase the data stored 
in the data temporary storage section if either clear request is 

15 received in the normal operation state. 

[0008] As a second example method of switching, the connection 
management section may select the empty data storage section as 
the write destination in the transmitting-end clear wait state, 
and in the receiving-end clear wait state, regard as old data any 

20 data that is stored in the data temporary storage section when 
the transmitting-end clear request has been received, select as 
the write destination a region in the data temporary storage section 
where the old data is not stored, and select as the read source 
a region in the data temporary storage section where the old data 

25 is stored while the old data is present (and select the empty data 

5 



storage section as the read source once the old data is no longer 
present ) . When this method of switching is adopted , the connection 
management section erases the data stored in the data temporary 
storage section if the receiving-end clear request is received 
5 in the normal operation state, and erase the old data if the 
receiving- end clear request is received in the receiving-end clear 
wait state. 

[0009] The transmitting-end processing section and the 
receiving-end processing section may output the transmitting-end 
10 clear request and the receiving-end clear request and perform 
transmission and reception of data by using a data 
transmission/reception section which provides a accessing 
function to the connection management section. 

[0010] The connection management section may be structured to 
15 be capable of selecting, if the data transmitted from the 
transmitting-end processing section cannot be written to the data 
temporary storage section, whether to perform a process of 
immediately notifying an error to the transmitting-end processing 
section , or a process of waiting until it becomes possible to write 
20 data to the data temporary storage section and notifying to the 
transmitting-end processing section a result of writing data to 
the data temporary storage section. Alternatively, the 
connection management section may be structured to be capable of 
selecting, if data to be received by the receiving- end processing 
25 section cannot be read from the data temporary storage section, 
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a process of immediately notifying an error to the receiving- end 
processing section, or a process of waiting until it becomes 
possible to read data from the data temporary storage section and 
notifying to the receiving-end processing section a result of 
reading data from the data temporary storage section. 
[0011] The stream data processing apparatus may further 
comprise a data input section via which to input the stream data, 
and/or a data output section for outputting a result of performing 
the multiple steps of processing for the stream data. The data 
input section may input the stream data from a removable recording 
medium . The data output section may output the result of performing 
the multiple steps of processing to a removable recording medium. 
[0012] These and other objects, features, aspects and 
advantages of the present invention will become more apparent from 
the following detailed description of the present invention when 
taken in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0013] FIG. 1 is a block diagram illustrating the structure 
of a stream data processing apparatus according to first and second 
embodiments of the present invention; 

FIG. 2 is a flowchart illustrating the operation of the 
stream data processing apparatus according to the first and second 
embodiments of the present invention in the case where a 
commencement of processing is instructed in a processing stopped 



state; 

FIG. 3 is a flowchart illustrating the operation of the 
stream data processing apparatus according to the first and second 
embodiments of the present invention in the case where a change 
5 of the subject of processing is instructed in a normal operation 
state; 

FIG. 4 is a flowchart illustrating the operation of a 
connection management section of the stream data processing 
apparatus according to the first embodiment of the present 
10 invention; 

FIG. 5 is a diagram illustrating a manner in which data 
is transmitted or received in the stream data processing apparatus 
according to the first and second embodiments of the present 
invention in a normal operation state; 

15 FIG. 6 is a diagram illustrating a manner in which data 

is transmitted or received in the stream data processing apparatus 
according to the first embodiment of the present invention in a 
receiving-end clear wait state; 

FIG. 7 is a diagram illustrating a manner in which data 

20 is transmitted or received in the stream data processing apparatus 
according to the first and second embodiments of the present 
invention in a transmitting-end clear wait state; 

FIG. 8 is a table illustrating the operation of the 
connection management section of the stream data processing 

25 apparatus according to the first embodiment of the present 
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invention; 

FIG. 9 is a flowchart illustrating the operation of a 
connection management section of the stream data processing 
apparatus according to the second embodiment of the present 
invention; 

FIG, 10 is a diagram illustrating a manner in which data 
is transmitted or received in the stream data processing apparatus 
according to the second embodiment of the present invention in 
a receiving-end clear wait state, in the case where old data is 
present ; 

FIG. 11 is a diagram illustrating a manner in which data 
is transmitted or received in the stream data processing apparatus 
according to the second embodiment of the present invention in 
a receiving-end clear wait state, in the case where old data is 
no longer present; 

FIG. 12 is a table illustrating the operation of the 
connection management section of the stream data processing 
apparatus according to the second embodiment of the present 
invention; and 

FIG. 13 is a block diagram illustrating the structure 
of a stream data processing apparatus according to a variant of 
the present invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
(first embodiment ) 



♦ 



[0014] FIG. 1 is a block diagram illustrating the structure 
of a stream data processing apparatus according to the first 
embodiment of the present invention. The stream data processing 
apparatus 10 shown in FIG. 1 comprises a control section 11, a 
5 data input section 12, a first processing section 13, a second 
processing section 14, a data output section 15, a connection 
management section 21, a data temporary storage section 22, an 
empty data storage section 23, a data transmission section 24, 
and a data reception section 25. The stream data processing 
10 apparatus 10 performs two steps of processing for inputted stream 
data. As used herein, "stream data" refers to data which is 
inputted/outputted or processed in a chronological order, e.g. , 
audio data or video data. 

[0015] The control section 11 is a means for controlling the 
15 operation of the stream data processing apparatus 10. When a 
command is inputted from a user, or when an abnormality occurs 
in the apparatus, for example, the control section 11 outputs 
control signals 31 and 32, respectively, to the first processing 
section 13 and the second processing section 14. 
20 [0016] The data input section 12 is a means by which to input 
stream data. The data input section 12 may be a storage device 
such as a hard disk drive or a memory, for example. The data input 
section 12, when composed of such a storage device, stores stream 
data in a predetermined format, and outputs the data contained 
25 in the stream data in a chronological order. Alternatively, the 




data input section 12 may be a communication controlling device 
which performs communications with, e.g., a server (not shown) 
which is coupled to data input section 12 via a network. The data 
input section 12 , when composed of such a communication controlling 
5 device, receives the data contained in stream data in a 
chronological order via communications, and outputs the received 
data in the order in which they are received. 

[0017] The first and second processing sections 13 and 14 
perform two steps of processing for the inputted stream data. More 

10 specifically, the first processing section 13 performs a first 
step of processing for the data which has been inputted in a 
chronological order via the data input section 12, and transmits 
the processed data to the second processing section 14 . The second 
processing section 14 receives the data which has been transmitted 

15 from the first processing section 13, and performs a second step 
of processing for the received data. In the structure shown in 
FIG. 1, the first processing section 13 functions as a 
transmitting-end processing section, and the second processing 
section 14 functions as a receiving-end processing section. 

20 [0018] The content of the processes performed by the first 
processing section 13 and the second processing section 14 may 
be arbitrary. Examples of the first processing section 13 and 
the second processing section 14 may be MPEG (Moving Pictures 
Experts Group) encoders, MPEG decoders, D/A converters for 

2 5 converting digital audio data to analog audio data, source filters 




used for obtaining data from a memory or the like, or renderer 
filters for adjusting the output timing of video signals. 
[0019] The data output section 15 is an output means for 
outputting the processing result obtained by subjecting the 
5 inputted stream data to the two-step processing. The data output 
section 15 may be an output device such as a display device or 
a loudspeaker. Alternatively, the data output section 15 may be 
a storage device such as a hard disk drive or a memory. The data 
output section 15, when composed of such a storage device, stores 

10 the chronologically-outputted processing results in a 
predetermined format. Alternatively, the data output section 15 
may be a communication controlling device which performs 
communications with, e.g., a server (not shown) which is coupled 
to the data output section 15 via a network . The data output section 

15 15, when composed of such a communication controlling device, 
transmits via communications the aforementioned processing 
results in the order in which they are outputted. 
[0020] The connection management section 21 utilizes the data 
temporary storage section 22 to allow the data which has been 

20 transmitted from the first processing section 13 to be received 
by the second processing section 14. More specifically, in 
response to a transmission request from the first processing 
section 13, the connection management section 21 writes to the 
data temporary storage section 22 the data transmitted from the 

25 first processing section 13. In response to a reception request 



from the second processing section 14, the connection management 
section 21 allows the second processing section 14 to receive the 
data which has been read from the data temporary storage section 
22. The data temporary storage section 22 temporarily stores the 
5 data which has been transmitted from the first processing section 
13. The data temporary storage section 22 may be composed of, 
for example , a storage device such as a hard disk drive or a memory. 
In order to ensure efficient management and storage of data, a 
buffer structure may be adopted for the data temporary storage 

10 section 22, e.g., queue, double buffer, or a ring buffer. 

[0021] If it is impossible to write to the data temporary storage 
section 22 the data which has been transmitted from the first 
processing section 13 (e.g. , if the data temporary storage section 
22 is full), the connection management section 21 waits until it 

15 becomes possible to write data to the data temporary storage section 
22, and notifies to the first processing section 13 a result of 
writing data to the temporary storage section 22. If it is 
impossible to read from the data temporary storage section 22 any 
data which is to be received by the second processing section 14 

20 (e.g., if the data temporary storage section 22 is empty), the 
connection management section 21 waits until it becomes possible 
to read data from the data temporary storage section 22 , and notifies 
to the second processing section 14 a result of reading data from 
the temporary storage section 22. In the stream data processing 

25 apparatus 10 comprising the connection management section 21 which 

13 



operates in this manner, the processing by the first processing 
section 13 may be halted until completion of data transmission, 
or the processing by second processing section 14 may be halted 
until completion of data reception, depending on the state of the 
5 data temporary storage section 22 . In such situations , the stream 
data processing apparatus 10 is said to be operating in a "blocking 
mode" . 

[0022] In the stream data processing apparatus 10, when 
accessing the connection management section 21, either the data 

10 transmission section 24 or the data reception section 25 is used. 
The data transmission section 24 provides a data transmission 
function, which is realized via the connection management section 
21. The data reception section 25 provides a data reception 
function, which is realized via the connection management section 

15 21. The data transmission function provided by the data 
transmission section 24 and the data reception function provided 
by the data reception section 25 are implemented by means of a 
unified interface. In the stream data processing apparatus 10, 
the first processing section 13 utilizes the data transmission 

20 section 24 when transmitting data to the second processing section 
14 via the connection management section 21 . The second processing 
section 14 utilizes the data reception section 25 when receiving 
data from the first processing section 13 via the connection 
management section 21. 

25 [0023] Specific examples of the data transmission section 24 

14 



and the data reception section 25 will be described. For example, 
a case will be described where the stream data processing apparatus 
10 is implemented as a multi-thread system which operates on a 
certain operating system (hereinafter referred to as "OS"). In 
this case, the stream data processing apparatus 10 is designed 
by utilizing an inter- thread communication function which is 
supported by the OS. Note that, by providing the designer of the 
stream data processing apparatus 10 with a system library for 
utilizing the functions of the OS, the designer of the stream data 
processing apparatus 10 can design threads which perform 
inter- thread communications by simply using the provided system 
library, without knowing the details of the operational principles 
of the OS . Referring to FIG . 1 , the connection management section 
21 would correspond to a portion of the OS that supports the 
inter- thread communication function, and the data transmission 
section 24 and the data reception section 25 would correspond to 
a portion of the system library that is related to the use of the 
inter- thread communication function . Thus , by utilizing the data 
transmission section 24 and the data reception section 25, the 
designer of the stream data processing apparatus 10 will be able 
to design the first processing section 13 and the second processing 
section 14 so as to be capable of performing data exchanges via 
the connection management section 21, without knowing the 
operational details of the connection management section 21. 
[0024] In a normal operation state, the constituent elements 



of the stream data processing apparatus 10 operate as described 
above. Thus, the stream data processing apparatus 10 performs 
a two-step pipeline processing for the inputted stream data. For 
example, under the assumptions that the data input section 12 is 
a storage device which stores an MPEG video stream; the first 
processing section 13 is an MPEG video decoder; the second 
processing section 14 is a renderer filter; and the data output 
section 15 is a display device, the stream data processing apparatus 
10 performs the processing of decoding and displaying an MPEG video 
stream in two steps. 

[0025] In the stream data processing apparatus 10, it may 
sometimes become necessary to change the subject of processing, 
for example, when a command is inputted from the user, or when 
an abnormality occurs within the apparatus. As used herein, a 
"change of the subject of processing" refers to a seek (i.e., 
commencing processing at a different position in a given stream 
of data which is being processed) , or a change of stream data (i.e. , 
commencing processing for a stream of data which is different from 
a given stream of data which is being processed), for example. 
[0026] When it becomes necessary to change the subject of 
processing, the control section 11 outputs a control signal 31 
for instructing a change of the subject of processing to the first 
processing section 13, and either simultaneously or slightly 
earlier or later than this , outputs a control signal 32 instructing 
the same to the second processing section 14 . If the control signal 



V 



31 is received from the control section 11, the first processing 
section 13 outputs a transmitting-end clear request 41 to the 
connection management section 21 by using the data transmission 
section 24, in order to erase the data stored in the data temporary 
5 storage section 22 . Similarly, if the control signal 32 is received 
from the control section 11, the second processing section 14 
outputs a receiving-end clear request 42 to the connection 
management section 21 by using the data reception section 25. 
[0027] Based on the transmitting-end clear request 41 or the 

10 receiving-end clear request 42 , the connection management section 
21 operates as follows. The connection management section 21 is 
in a normal operation state until receiving the transmitting-end 
clear request 41 or the receiving-end clear request 42 . In a normal 
operation state, data which is transmitted from the first 

15 processing section 13 is written to the data temporary storage 
section 22 , and data to be received by the second processing section 
14 is read from the data temporary storage section 22. If a 
transmitting-end clear request 41 is received in a normal operation 
state, the connection management section 21 transitions to a 

20 receiving-end clear wait state, in which the data to be received 
by the second processing section 14 is read from the empty data 
storage section 23 . If a receiving-end clear request 42 is received 
in a normal operation state, the connection management section 
21 transitions to a transmitting-end clear wait state, in which 

2 5 the data which is transmitted from the first processing section 



13 is written to the empty data storage section 23. If a 
receiving-end clear request 42 is received in a receiving-end clear 
wait state or if a transmitting-end clear request 41 is received 
in a transmitting-end clear wait state, the connection management 
section 21 transitions to a normal operation state. The details 
of the operation of the connection management section 21 will be 
described later (with reference to FIG. 4). 

[ 0028 ] The empty data storage section 23 is a buffer which erases 
any data that is written thereto, and which returns empty data 
to any device which attempts to read data therefrom. In other 
words, any data that is written to the empty data storage section 
23 will not be stored in the empty data storage section 23. Even 
if a data read from the empty data storage section 23 is attempted, 
only empty data (i.e., 0 bytes) can be read from the empty data 
storage section 23. A specific example of the empty data storage 
section 23 is a null device which is supported by some OS's. 
[0029] Hereinafter, referring to FIGS. 2 to 4 , the details of 
the operation of the stream data processing apparatus 10 will be 
described. FIG. 2 is a flowchart illustrating the operation of 
the stream data processing apparatus in the case where a 
commencement of processing is instructed in a processing stopped 
state. FIG. 3 is a flowchart illustrating the operation of the 
stream data processing apparatus in the case where a change of 
the subject of processing is instructed in a normal operation state . 
FIG. 4 is a flowchart illustrating the operation of the connection 

18 



management section 21. 

[0030] If a commencement of processing is instructed in a 
processing stopped state, the stream data processing apparatus 
10 performs the process shown in FIG. 2. The process shown in 
FIG. 2 is started when the user inputs a begin-process command 
to the stream data processing apparatus 10. If the user inputs 
a begin-process command, the control section 11 receives the 
inputted begin-process command (step S101). Next, the control 
section 11 outputs a control signal 31 which instructs a 
commencement of processing to the first processing section 13, 
and either simultaneously or slightly earlier or later than this, 
outputs a control signal 32 instructing the same to the second 
processing section 14 (step S102). 

[ 0031 ] After step S102 is executed , the first processing section 

13 executes steps Sill to S114, and the second processing section 

14 executes steps S131 to S134. Also, the connection management 
section 21 performs a process shown in FIG. 4 (step S121) as 
described later, independently from the processes performed by 
the first processing section 13 and the second processing section 
14. In other words, after step S102 is executed, the process by 
the first processing section 13, the process by the second 
processing section 14 , and the process by the connection management 
section 21 are performed in parallel or concurrently in the stream 
data processing apparatus 10. 

[0032] The first processing section 13 repeatedly executes 

19 



« * 
» * 

steps Sill to S114 as described below until its processing for 
the stream data is completed. From the data input section 12 , 
the first processing section 13 receives as an input the data 
contained in the stream data to be processed (step Sill) . Next, 
5 the first processing section 13 subjects the inputted data to a 
process which is specific to the first processing section 13 (step 
S112) . Then, by using the data transmission section 24, the first 
processing section 13 transmits the processed data to the 
connection management section 21 (step S113). Then, the first 

10 processing section 13 determines whether its processing for the 
stream data has been completed or not (step S114). If it is 
determined that the processing is complete, the first processing 
section 13 stops processing. On the other hand, if it is determined 
that processing is incomplete, the first processing section 13 

15 proceeds to step Sill. 

[0033] The second processing section 14 repeatedly executes 
steps S131 to S134 as described below until its processing for 
the stream data is completed. By using the data reception section 
25, the second processing section 14 receives from the connection 

20 management section 21 the data which has been transmitted from 
the first processing section 13 (step S131). Next, the second 
processing section 14 subjects the received data to a process which 
is specific to the second processing section 14 ( step S132 ) . Then, 
the second processing section 14 outputs the processed data to 

25 the data output section 15 ( step S133 ) . Then, the second processing 

20 



section 14 determines whether its processing for the stream data 
has been completed or not (step S134). If it is determined that 
the processing is complete, the second processing section 14 stops 
processing . On the other hand , if it is determined that processing 
5 is incomplete, the second processing section 14 proceeds to step 
S131. 

[0034] If a change of the subject of processing is instructed 
in a normal operation state, the stream data processing apparatus 
10 performs the process shown in FIG. 3. The process shown in 

10 FIG. 3 is started when the user inputs a seek command, a stream 
data change command, or the like. If the a seek command, a stream 
data change command , or the like is inputted by the user , the control 
section 11 receives the inputted command (step S141) . Next, the 
control section 11 outputs a control signal 31 instructing a change 

15 of the subject of processing to the first processing section 13, 
and either simultaneously or slightly earlier or later than this, 
outputs a control signal 32 instructing the same to the second 
processing section 14 (step S142). 

[0035] After stepS142 is executed, the first processing section 
20 13 outputs a transmitting-end clear request 41 to the connection 
management section 21 by using the data transmission section 24 
(step S110), and the second processing section 14 outputs a 
receiving-endclear request 42 to the connection management section 
21 by using the data reception section 25 (step S130). At this 
25 time , it depends on the structure or operational state of the stream 



data processing apparatus 10 which one of the transmitting-end 
clear request 41 and the receiving-end clear request 42 is outputted 
first . 

[0036] After executing step S110, the first processing section 
5 13 repeatedly executes steps Sill to S114 as in the case illustrated 
in FIG- 2. Also, after executing step S130, the second 
processing section 14 repeatedly executes steps S131 to S134, as 
in the case illustrated in FIG. 2. Henceforward, as in the case 
illustrated in FIG. 2, in the stream data processing apparatus 

10 10 , the process by the first processing section 13, the process 
by the second processing section 14, and the process by the 
connection management section 21 are performed in parallel or 
concurrently in the stream data processing apparatus 10. 
[0037] As shown in FIG. 4, the connection management section 

15 21 executes steps S201 and S202 in anormal operation state , executes 
steps S211 to S213 in a receiving-end clear wait state (i.e., a 
state which exists after a transmitting-end clear request 41 is 
received and until a receiving-end clear request 42 is received) , 
and executes steps S221 to S223 in a transmitting-end clear wait 

20 state (i.e., a state which exists after a receiving-end clear 
request 42 is received and until a transmitting-end clear request 
41 is received). In the following description, the data which 
is transmitted from the first processing section 13 will be referred 
to as "transmission data" , and the data to be received by the 

25 second processing section 14 will be referred to as 



"data- to-be-received" . 

[0038] In a normal operation state, the connection management 
section 21 selects the data temporary storage section 22 both as 
a destination at which to write transmission data (hereinafter 
5 referred to as a "write destination for transmission data" ) and 
as a source from which to read the data- to-be-received (hereinafter 
referred to as a "read source of data- to-be-received" ) . Thus, 
in a normal operation state, the connection management section 
21 writes transmission data to the data temporary storage section 

10 22, and reads data- to-be-received from the data temporary storage 
section 22 (step S201) . Next, the connection management section 
21 determines whether a clear request has been received from the 
first processing section 13 or the second processing section 14 
(step S202). If a transmitting-end clear request 41 has been 

15 received, the connection management section 21 proceeds to step 
S211; if a receiving-end clear request 42 has been received, the 
connection management section 21 proceeds to step S221; if neither 
clear request has been received, the connection management section 
21 proceeds to step S201. 

20 [0039] FIG* 5 is a diagram illustrating a manner in which data 
is transmitted or received at step S201. In FIG. 5, the write 
destination for transmission data and the read source of 
data-to-be-received are both set to be the data temporary storage 
section 22. The data temporary storage section 22 is illustrated 

25 as storing three pieces of data which have been transmitted from 



the first processing section 13 but not yet received by the second 
processing section 14. 

[0040] Referring back to FIG- 4, if step S202 finds that a 
transmitting-end clear request 41 has been received , the connection 
5 management section 21 erases the data which is stored in the data 
temporary storage section 22 (step S211). Next, the connection 
management section 21 selects the empty data storage section 23 
as the read source of data- to-be-received, while still selecting 
the data temporary storage section 22 as the write destination 

10 for transmission data . Thus , in a receiving-end clear wait state , 
the connection management section 21 writes transmission data to 
the data temporary storage section 22, and reads 
data- to-be-received from the empty data storage section 23 (step 
S212). Next, the connection management section 21 determines 

15 whether a receiving-end clear request 42 has been received from 
the second processing section 14 (step S213) . If a receiving-end 
clear request 42 has been received, the connection management 
section 21 proceeds to step S201; otherwise, control proceeds to 
step S212. 

20 [0041] FIG. 6 is a diagram illustrating a manner in which data 
is transmitted or received at step S212. In FIG. 6, the write 
destination for transmission data is set to be the data temporary 
storage section 22 , whereas the read source of data- to-be-received 
is set to be the empty data storage section 23. Any data which 

25 is stored in the data temporary storage section 22 is once erased 
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at step S211. In FIG. 6, the data temporary storage section 22 
is illustrated as storing three pieces of data which were 
transmitted from the first processing section 13 after the data 
erasure but not yet received by the second processing section 14. 
5 [0042] While the connection management section 21 is in a 
receiving-end clear wait state, the second processing section 14 
will request the connection management section 21 to receive the 
rest of the data which the second processing section 14 was 
processing, despite the fact that the first processing section 

10 13 has already changed its subject of processing. However, the 
"rest" of the data, which was stored in the data temporary storage 
section 22 while the connection management section 21 is in a normal 
operation state, has already been erased because the connection 
management section 21 has executed step S211. Moreover, while 

15 the connection management section 21 is in a receiving-end clear 
wait state, the first processing section 13 requests to the 
connection management section 21 that new data which emerged after 
the change of the subject of processing be transmitted, and so 
the connection management section 21 writes such transmission data 

20 to the data temporary storage section 22. Therefore, without 
providing a solution to this situation, the second processing 
section 14 would mistakenly receive the new data which emerged 
after the change of the subject of processing transmitted from 
the first processing section 13, and process such data as the rest 

25 of the data which the second processing section 14 was processing . 
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As a solution to this problem, as described above, the connection 
management section 21 sets the read source of data-to-be-received 
to be the empty data storage section 23 in a receiving-end clear 
wait state. As a result, while the connection management section 
5 21 is in a receiving-end clear wait state, the second processing 
section 14 is prevented from receiving anything but empty data. 
Thus, the aforementioned problem is solved so that the stream data 
processing apparatus 10 is prevented from malfunctioning. 
[0043] Referring back to FIG. 4, if step S202 finds that a 

10 receiving-end clear request 42 has been received, the connection 
management section 21 erases the data stored in the data temporary 
storage section 22 (step S221) . Next, the connection management 
section 21 selects the empty data storage section 23 as the write 
destination for transmission data, while still selecting the data 

15 temporary storage section 22 as the read source of 
data- to-be-received. Thus, in a transmitting-end clear wait 
state, the connection management section 21 writes transmission 
data to the empty data storage section 23, and reads 
data-to-be-received from the data temporary storage section 22 

20 (step S222). Next, the connection management section 21 
determines whether a transmitting-end clear request 41 has been 
received from the first processing section 13 (step S223). If 
a transmitting-end clear request 41 has been received, the 
connection management section 21 proceeds to step S201 ; otherwise , 

25 control proceeds to step S222. 



[0044] FIG. 7 is a diagram illustrating a manner in which data 
is transmitted or received at step S222. In FIG. 7, the write 
destination for transmission data is set to be the empty data storage 
section 23 , and the read source of data-to-be-received is set to 
5 be the data temporary storage section 22 . Any data which is stored 
in the data temporary storage section 22 is erased at step S221, 
and any data which is transmitted from the first processing section 
13 after the data erasure is written to the empty data storage 
section 23. As a result, in FIG. 7 , the data temporary storage 

10 section 22 is illustrated as storing no data. 

[0045] While the connection management section 21 is in a 
transmitting-end clear wait state, the first processing section 
13 as the transmitting-end processing section will request that 
the rest of the data which the first processing section 13 was 

15 processing be transmitted, despite the fact that the second 
processing section 14 has already changed its subject of processing . 
However, the second processing section 14 requests the connection 
management section 21 to receive new data which emerged after the 
change of the subject of processing . Therefore , without providing 

20 a solution to this situation, the second processing section 14 
would mistakenly receive the rest of the data which the first 
processing section 13 was processing and transmitted, and process 
such data as new data which emerged after the change of the subject 
of processing. As a solution to this problem, as described above, 

25 in a transmitting-end clear wait state, the connection management 



section 21 sets the write destination for transmission data to 
be the empty data storage section 23. As a result, while the 
connection management section 21 is in a transmitting-end clear 
wait state, the second processing section 14 is prevented from 
receiving anything but empty data. Thus, the aforementioned 
problem is solved so that the stream data processing apparatus 
10 is prevented from malfunctioning. 

[0046] FIG. 8 is a table illustrating the above-described 
operation (FIG. 4) of the connection management section 21. In 
the table of FIG. 8, the processes described in the upper left 
column and the lower right column are the processes to be performed 
in a normal operation state (step S201) ; the processes described 
in the lower left column are the processes to be performed in a 
receiving-end clear wait state (step S212); and the processes 
described in the upper right column are the processes to be performed 
in a transmitting-end clear wait state (step S222). 
[0047] As described above, in accordance with the stream data 
processing apparatus of the present embodiment , in a normal 
operation state, the connection management section utilizes the 
data temporary storage section as a buffer for allowing the data 
transmitted from the first processing section (as the 
transmitting-end processing section) to be received by the second 
processing section (as the receiving-end processing section) . If 
it becomes necessary to change the subject of processing due to 
a seek or change of stream data, etc. , the first processing section 
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and the second processing section output a transmitting-end clear 
request and a receiving-end clear request, respectively, in 
response to an instruction from the control section. When either 
type of clear request is received in a normal operation state, 
5 the connection management section erases any data stored in the 
data temporary storage section, and sets the read source of 
data-to-be-received to be the empty data storage section in a 
receiving-end clear wait state, and sets the write destination 
for transmission data to be the empty data storage section in a 

10 transmitting-end clear wait state. 

[0048] Thus, when the subject of processing is changed, the 
second processing section is prevented from mistakenly receiving 
any new data which emerged after the change of the subject of 
processing and processing it as the rest of the data which the 

15 second processing section 14 was processing, or receiving the rest 
of the data which the first processing section was processing and 
processing such data as new data which emerged after the change 
of the subject of processing. Thus, by properly exchanging data 
between a plurality of processing sections while achieving 

20 synchronization therebetween, the stream data processing 
apparatus can operate with a good overall integrity. 
[0049] Moreover, each processing section only needs to respond 
to an instruction of a change of the subject of processing from 
the control section by outputting a clear request ; other than that , 

25 the processing section can continue to properly exchange data by 



requesting data transmission/reception. Thus, each processing 
section is capable of properly performing the exchange of data 
without having to pay attention to the data content or the state 
of another processing section with which data is exchange. As 
5 a result , the structure of each processing section can be simplified . 
In particular, in the case where each processing section is 
implemented in software, the software structure of each processing 
section can be simplified, thereby facilitating the design of the 
software components implementing the processing sections. A 
10 simpler software structure provides the advantage of reducing the 
amount of program code , which in turn makes for an improved software 
quality. 

[0050] Moreover, each processing section exchanges data by 
using a data transmission provided by the data transmission section 

1 5 and a data reception function provided by the data reception section , 
which are implemented by means of a unif led interface . As a result , 
the structure of each processing section is further simplified. 
In the case where each processing section is implemented in software , 
the software structure of each processing section can be even more 

20 simplified, and the reusability of each processing section is 
enhanced. Thus, in the case where each processing section is 
implemented in software, it is made easier to port the software 
component constituting each processing section into another 
system. 

25 (second embodiment) 



[0051] The stream data processing apparatus according to the 
first embodiment of the present invention is illustrated as erasing 
any data stored in the data temporary storage section when a 
transmitting-end clear request or a receiving-end clear request 
5 is outputted in a normal operation state. On the other hand, a 
stream dataprocessing apparatus according to the second embodiment 
of the present invention is characterized in that, if a 
transmitting-end clear request is outputted first in a normal 
operation state, any data stored in the data temporary storage 
10 section is not erased, and in a receiving-end clear wait state, 
both new data and old data are stored in the data temporary storage 
section, in such a manner that the new data is distinguishable 
from the old data. 

[0052] The stream data processing apparatus of the present 
15 embodiment has the same structure as that of the stream data 
processing apparatus of the first embodiment (as illustrated in 
FIG. 1), and performs the same processes as those performed by 
the stream data processing apparatus of the first embodiment in 
the case where a commencement of processing is instructed in a 
20 processing stopped state (FIG. 2) or a change of the subject of 
processing is instructed in a normal operation state (FIG. 3). 
Therefore, any description of these aspects will be omitted in 
the present embodiment. The stream data processing apparatus of 
the present embodiment differs from the stream data processing 
25 apparatus of the first embodiment with respect to the operation 



of the connection management section 21 in a receiving -end clear 
wait state. 

[0053] FIG, 9 is a flowchart illustrating the operation of the 
connection management section 21 of the stream data processing 
5 apparatus according to the second embodiment of the present 
invention. As shown in FIG. 9, the connection management section 
21 executes steps S201 andS202 in a normal operation state; executes 
steps S231 to S233 in a receiving-end clear wait state ; and executes 
steps S221 to S223 in a transmitting-end clear wait state. Since 

10 the process performed in a normal operation state and the process 
performed in a transmitting-end clear wait state are the same as 
those performed by the stream data processing apparatus of the 
first embodiment , the descriptions thereof are omitted (see FIG. 4) . 
In the following description, any data which is stored in the data 

15 temporary storage section 22 when a transmitting-end clear request 
41 has been outputted will be referred to as "old data", whereas 
any data which is transmitted from the first processing section 
13 while the connection management section 21 is in a receiving-end 
clear wait state will be referred to as "new data" . A region in 

20 the data temporary storage section 22 in which old data is stored 
will be referred to as an "old data region", whereas a region in 
the data temporary storage section 22 in which no old data is stored 
will be referred to as a "new data region" . 

[0054] As shown in FIG. 9, when step S202 finds that a 
25 transmitting-end clear request 41 has been received, the connection 



management section 21 proceeds to step S231 without erasing the 
old data. In this case, the connection management section 21 
selects the new data region as the write destination for 
transmission data, and selects the old data region as the read 
5 source of data-to-be-received. Note, however, that the old data 
region is selected as the read source of data- to-be-received only 
if there is any unread old data . Once old data is no longer present , 
the empty data storage section 23 is selected as the read source 
of data- to-be-received. Thus , in a receiving-end clear wait state , 
10 the connection management section 21 writes transmission data in 
the new data region, and reads data- to-be-received from the old 
data region (or from the empty data storage section 23 if no old 
data is present) (step S231). 

[0055] Next, the connection management section 21 determines 
15 whether a receiving-end clear request 42 has been received from 
the second processing section 14 (step S232) . If a receiving-end 
clear request 42 has been received, the connection management 
section 21 proceeds to step S233; otherwise, control proceeds to 
step S231. At step S233, the connection management section 21 
20 erases any old data present (step S233) , and thereafter proceeds 
to step S201. 

[0056] FIGS. 10 and 11 are diagrams illustrating manners in 
which data is transmitted or received at step S231. FIG. 10 
illustrates the case where old data is present. In FIG. 10, the 
25 data temporary storage section 22 is illustrated as storing two 
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pieces of old data (OLD_DATA5 and OLD_DATA6) and one piece of new 
data (NEW_DATA1), these two kinds of data being stored so as to 
be distinguishable from each other. If the first processing 
section 13 requests transmission of a next piece of new data in 
5 the state as shown in FIG. 10, the connection management section 
21 writes such data to the new data region in the data temporary 
storage section 22 (e.g. , in the next slot to the new data NEW_DATA1 ) . 
If the second processing section 14 requests receiving a next piece 
of old data (OLD_DATA5) in the state as shown in FIG. 10, the 
10 connection management section 21 reads such data from the old data 
region in the data temporary storage section 22, and transmits 
it to the second processing section 14. 

[0057] FIG. 11 illustrates the case where old data is no longer 
present. If the second processing section 14 requests receiving 

15 two pieces of old data and the first processing section 13 requests 
transmission of one new piece of data in the state shown in FIG . 10 , 
a state shown as in FIG. 11 results. In FIG. 11, the data 
temporary storage section 22 is illustrated as storing two pieces 
of new data (NEW__DATA1 and NEW_DATA2 ) . If the first processing 

20 section 13 requests transmission of a next piece of new data in 
the state shown in FIG. 11, the connection management section 21 
writes such data to the new data region in the data temporary storage 
section 22 (e.g., in the next slot to the new data NEW_DATA2 ) . 
If the second processing section 14 requests receiving a next piece 

25 of old data in the state shown in FIG. 11, the connection management 
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section 21 reads empty data from the empty data storage section 
23. Since the stream data processing apparatus 10 operates in 
a blocking mode, the processing by the second processing section 
14 will be halted until the completion of data reception. 
5 [0058] As in the first embodiment, while the connection 
management section 21 is in a receiving-end clear wait state, the 
second processing section 14 will request receiving old data, 
despite the fact that the first processing section 13 has already 
changed its subject of processing. Remember that in the first 

10 embodiment, the connection management section 21 executes step 
S211, so that old data would already have been erased. However 
in the present embodiment, the old data has not been erased at 
this point. Moreover, in a receiving-end clear wait state, the 
connection management section 21 writes transmission data as new 

15 data to the data temporary storage section 22, and reads as 
data-to-be-received the old data stored in the data temporary 
storage section 22. As a result, while the connection management 
section 21 is in a receiving-end clear wait state, the second 
processing section 14 can receive the old data, if any, but is 

20 prevented from receiving anything but empty data once old data 
is no longer present. Thus, the second processing section 14 can 
properly receive the old data stored in the data temporary storage 
section 22 and process it as the rest of the data which the second 
processing section 14 was processing. 

25 [0059] FIG. 12 is a table illustrating the above-described 



operation (FIG- 9) of the connection management section 21. In 
the table of FIG. 12, the processes described in the upper left 
column and the lower right column are the processes to be performed 
in a normal operation state (step S201) ; the processes described 
5 in the lower left column are the processes to be performed in a 
receiving-end clear wait state (step S231); and the processes 
described in the upper right column are the processes to be performed 
in a transmitting-end clear wait state (step S222). 
[0060] As described above, in accordance with the stream data 

10 processing apparatus of the present embodiment, in a normal 
operation state or in a transmitting-end clear wait state, the 
connection management section performs the same operation as that 
performed by the stream data processing apparatus of the first 
embodiment . On the other hand , in a receiving- end clear wait state , 

15 the connection management section regards any data stored in the 
data temporary storage section when a transmitting-end clear 
request has been received, and sets the write destination for 
transmission data to be the new data region in the data temporary 
storage section, and sets the read source of data- to-be-received 

20 to be the old data region in the data temporary storage section 
(or the empty data storage section once old data is no longer 
present) . 

[0061] Therefore, the stream data processing apparatus of the 
present embodiment provides , in addition to the advantages provided 
25 by the stream data processing apparatus of the first embodiment, 
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an advantage in that the second processing section can properly 
perform processing to the old data stored in the data temporary 
storage section after a transmit ting -end clear request is output ted 
and until a receiving-end clear request is outputted. 
5 [0062] Various variants of the stream data processing apparatus 
according to each embodiment of the present invention are possible , 
such as follows . 

The stream data processing apparatus of each embodiment 
as described above is illustrated as comprising two processing 

10 sections which perform two-step processing for inputted stream 
data. Alternatively, the stream data processing apparatus may 
comprise three or more processing sections to perform three or 
more steps of processing for inputted stream data. In this case, 
the stream data processing apparatus may realize data exchanges 

15 via the connection management section between any and all 
processing sections . 

[0063] FIG. 13 illustrates a variant stream data processing 
apparatus which performs three- step processing for inputted stream 
data. A stream data processing apparatus 50 shown in FIG. 13 

20 comprises a first processing section 53, a second processing 
section 54, and a third processing section 55 to perform three 
steps of processing for the stream data which is inputted via the 
data input section 52, and outputs the processing result from the 
data output section 56 . When a seek command or the like is inputted 

25 from the user, the control section 51 outputs control signals 61, 
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62 , and 63 to the first processing section 53 , the second processing 
section 54, and the third processing section 55, respectively* 
The first processing section 53 employs a data transmission section 
24a to transmit data to the second processing section 54. The 
5 second processing section 54 employs a data reception section 25a 
to receive data from the first processing section 53. Based on 
a transmitting-end clear request 41a and a receiving- end clear 
request 42a, the connection management section 21a performs data 
write and data read for the data temporary storage section 22a 

10 and the empty data storage section 23a, thereby allowing data which 
is transmitted from the first processing section 53 to be received 
by the second processing section 54. The data exchange between 
the second processing section 54 and the third processing section 
55 is handled in a similar manner. 

15 [0064] A stream data processing apparatus comprising three or 
more processing sections does not need to realize data exchanges 
via the connection management section between any and all 
processing sections. Instead, data exchanges via the connection 
management section may be realized only between some of the 

20 processing sections. For example, in the stream data processing 
apparatus 50 shown in FIG. 13, data exchanges via the connection 
management section may be performed between the first processing 
section 53 and the second processing section 54 while data exchanges 
which do not involve the connection management section may be 

25 performed between the second processing section 54 and the third 
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4 t • 

processing section 55* 

[0065] Although the stream data processing apparatus of each 
embodiment above is illustrated as operating in a blocking mode, 
the stream data processing apparatus may operate in a non-blocking 
5 mode as described below. Further alternatively, the stream data 
processing apparatus may be structured so as to be able to select 
between a blocking mode operation and a non-blocking mode operation . 
In that case, the processing performed by each processing section 
can be arbitrarily controlled, depending on the operational state 
10 of the apparatus or the like, so that the processing performed 
by each processing section is halted or not halted in a data 
reception/transmission wait state. 

[0066] In a stream data processing apparatus operating in a 
non-blocking mode, if transmission data cannot be written to the 

15 data temporary storage section, or if data- to-be-received cannot 
be read from the data temporary storage section, the connection 
management section immediately notifies an error to the processing 
section from which the transmission data originated or the 
processing section for which the data-to-be-received is intended. 

20 In this case, after requesting a data transmission or reception 
via the connection management section, each processing section 
waits until the data transmission or reception is complete, by 
performing data processes such as poll or select . Therefore , even 
if another event occurs during the waiting, the processing section 

25 can immediately perform a process related to that event. For 
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example, if the user instructs an interruption of processing to 
the control section during the waiting, the processing section 
can immediately stop processing in response to the processing 
interruption instruction which has been outputted from the control 
5 section. Thus, each processing section can perform a process 
related to another event even in a data transmission/reception 
wait state. As a result, when an instruction is inputted from 
the user , the stream data processing apparatus can promptly respond 
to the user 1 s instruction , without having to newly activate a thread 

10 for responding to the instruction. 

[0067] In the above embodiments, it is stated that the data 
input section 12 and/or the data output section 15 may be a storage 
device such as a hard disk or a memory. More specifically, the 
data input section 12 and/or the data output section 15 may be 

15 constructed so as to write data to or read data from a removable 
recording medium such as a memory card . In accordance with a stream 
data processing apparatus comprising such a data input section 
12 and such a data output section 15, it becomes possible to store 
the processing result obtained with a first apparatus to the 

20 removable recording medium, remove the recording medium from the 
first apparatus, and mount the recording medium to a second 
apparatus. In this manner, the second apparatus is enabled to 
continue from the processing by the first apparatus to reproduce 
stream data, perform a seek, or the like. 

25 [0068] The stream data processing apparatus according to the 



present invention enables data transmission or reception between 
processing sections in such a manner that one processing section 
does not need to pay attention to the state of the other processing 
section. Thus, the stream data processing apparatus according 
5 to the present invention can be utilized as a device for processing 
stream data , e . g . , reproduction device of audio data or video data . 
[0069] While the invention has been described in detail, the 
foregoing description is in all aspects illustrative and not 
restrictive. It is understood that numerous other modifications 
10 and variations can be devised without departing from the scope 
of the invention. 
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